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Abstract 

In this paper we develop an algorithm to optimise a nonlinear utility function of multiple objectives over 
the integer efficient set. Our approach is based on identifying and updating bounds on the individual 
objectives as well as the optimal utility value. This is done using already known solutions, linear 
programming relaxations, utility function inversion, and integer programming. We develop a general 
optimisation algorithm for use with k objectives, and we illustrate our approach using a tri-objective 
integer programming problem. 

Keywords: Multiple objective optimisation, integer programming, nonlinear utility function 
1 Introduction 

The majority of studies reported in the optimisation literature consider a single objective, 
such as minimising cost or maximising profit. However, in practice, there are usually many 
objectives that need to be considered simultaneously. In particular, the increasing effect of 
globalisation brings safety, environmental impact and sustainability issues, and hence their 
related performance measures, into consideration. The practical aim is to find solutions that 
are not only profitable but also safe, green and sustainable. 

Multi-Objective Integer Programming (MOIP) considers discrete feasible sets defined by 
integer variables. The main focus of literature on MOIP has been on enumerating the en- 
tire integer nondominated set, or on optimising a single linear utility function. However, 
many practical situations require the optimisation of a nonlinear utility function that com- 
bines multiple objectives into one. Prominent applications of such problems include, but are 
not limited to, pricing, routing, production planning, resource allocation, portfolio selection, 
capital budgeting, and designing networks. In such applications a utility function can capture 
precisely the decision maker's preferences for how to balance conflicting objectives, such as cost 
versus environmental impact in routing problems, or profit versus risk in portfolio selection. 

Besides their practical importance, these optimisation problems are theoretically chal- 
lenging as they — even their simpler single-objective versions — fall into the class of NP-hard 
problems. Despite their practical and theoretical importance, there is no reported research on 
such problems, at least to the best of our knowledge. Recognising this gap in the literature, 
in this paper we address the optimisation of an explicitly defined nonlinear utility function 
of multiple objectives over the integer efficient set, and provide a general framework for its 
resolution. 



1 



Throughout this paper we assume that the utility function is strictly increasing with respect 
to each individual objective. Such monotonicity is standard for a utility function, whose role 
is to combine many individual objectives into a single global "utility objective". 

A MOIP problem defines a discrete feasible set of efficient points and corresponding non- 
dominated objective vectors, and the optimal value of our nonlinear utility function can always 
be found in this nondominated set. A naive solution to our optimisation problem could there- 
fore be to generate all nondominated objective vectors for the MOIP problem, and then to 
evaluate the utility function in each case. However, this naive approach would be highly 
impractical, since the number of nondominated vectors can be extremely large in general. 

Recognising this, we develop a more sophisticated approach to optimise a nonlinear utility 
function over the integer efficient set, in which we generate only a smaller subset of non- 
dominated objective vectors. To avoid the generation of unpromising solutions, we compute 
objective optimality bounds by combining the best solution found so far with the nonlinear 
utility function. To generate the subset of promising nondominated objective vectors, we use 
an algorithm by IQzlen and Azizoglul 20091 ] that recursively solves MOIP problems with fewer 
objectives. 

The rest of the paper is organised as follows. Section [2] reviews the related literature. 
In Section [3] we explain our algorithm in full and prove its correctness. Section [4] offers a 
detailed illustration of the workings of the algorithm, using an instance of a tri-objective 
integer programming problem. We conclude in Section [5] 



2 Literature 



The best-studied cases of MOIP are Multi-Objective Combinatorial Optimisation (MOCO) 
problems. These are special cases of MOIP that have special constraint set structures. 
Ehrgott and Gandibleuxl 200CJ, l2004j provide rich surveys of MOCO studies that use exact 
and approximate approaches, respectiv ely. They address some special p roblem structures and 



discuss their solution methodologies. Ehrgott and Gandibleuxl [20021 ] survey other MOCO 



problems including, but not limited to, nonlinear programming, scheduling and multi-level 
programming. These recent studies show a considerable growth in the MOCO literature. 
However, research on generating all nondominated objective vectors for MOIP, or on optim- 
isa tion over that set, i s still s carce. 



Klein and Hannanl 19821 ] develop an approach based on the sequential solutions of the 



single-objective Integer Programming (IP) problems. Their algorith m generates a subset, but 
not necessarily the whole set, of all nondom i nated objective vectors. ISvlva and Cremal [2004] 
improve the approach of Klein and Hannanl 1982| by defining a weighted combination of all 
obj ectives, and their appr oac h guarantees to generate all nondominated objec tive vectors. 



.Klamroth et al.1 [2004] and lEhrgottl [20061 ] study the general MOIP problem. iKlamroth et al. 
2004j " discuss the importance of using upper bounds on the objective function values when 



generating the nondominated set, and define composite functions to obtain such bounds. To 
form the composite functions, they pr o pose classical optimisation methods such as cutting 
plane and branch and bound. lEhrgottl [20061 ] discusses various scalarisation techniques, and 
proposes a generalised technique that encompasses the others as special cases. He also proposes 
an elastic constraint method to identify all nondominated points, whose power is dependent 
on the existence of sophisticated problem-dependent methods for solving the single objective 
version. 
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Ozlen and Azizoglul |2009l | develop a general approach to generate all nondominated ob- 
jective vectors for the MOIP problem, by recursi vely identifying upper bounds on individual 
objectives using problems with fewer objectives. iDhaenens et al.l 20101 ] present a similar but 
parallel algorith m for MOCO problems, t hat again involves recursively s olvin g problems with 
fewer objectives. iPrzvbvlski et al.l |2010bl | and lOzpevnirci and Koksalanl [20101 ] propose similar 
algorithms to identify all extreme nondominated objective vectors for a MOIP problem. They 
both utilise a weighted single-objective function and partition the weight space to identify 
the set of extreme supported nondominated objective vectors , adapting a method first pro - 
posed for Multi-Object ive Linear Programming (MOLP) bv iBenson and Sun! |2000l . l2002| . 



Przybylski et al.l 2010a| extend the two phase method, originally developed to generate the 



nondominated set for bi-objective problems, to handle problems with three or more objectives. 

There are some recent studi es proposing preference-based methods for specific MOCO 
problems. iLe Huede et al.l |2006l | optimise a utility function in Multi- Attribute Utility The- 
ory (MAUT) that is composed of piecewise-l inear utility functions and a Choquet integral in 
a constraint programming-based algorithm. iPernv and Spanjaardl [2005] propose algorithms 
that consider any preorder for a multiobjective minimum weight spanning tree problem. For 
the same problem, |G aland et al.l |2010a| propose a branch and bound algorithm minimising a 
utility function comp osed of a concave Choquet integral and a partial convex utility function. 
G aland et al.l [2010bl ] also propose a branch and bound algorithm maximising a convex Cho- 
quet integral function for the multiobjective knapsack problem. Contrary to these preference- 
based studies, the method we propose in this paper is not problem-specific: it can be used 
with any MOIP problem, and requires no particular assumption about the utility function 
beyond the natural assumption of monotonicity. 

There a re few studies dealing with g ener al MOIP pro blems in which the aim is to optimise 
a function. Abbas and Chaabane 20061 ] and Jorge 20091 ] deal with optimising a linear function 
over the efficient set of a MOIP problem. 



3 The algorithm 



In its general form, our algorithm optimises a nonlinear utility function of k objectives over 
the integer programming efficient set. This problem can be defined precisely as: 

MinG(/i(x),/ 2 (x),...,/ fc (x)) 
s.t. x £ X, 

where X is the set of feasible points defined by Ax = b, Xj > and XjE Z for all j € 
{1,2,... ,n}. 

The individual objectives are defined as f\{x) = Y^j=i c ij x ji fa( x ) = Sj=i c 2j x ji ■ ■ ■ > an< ^ 
fk(x) = =1 c kj x ji where Cij £ Z for all i € {1, 2, . . . , k} and j £ {1, 2, . . . , n}. The nonlinear 
utility function G(fi(x), f2(x), . . . , fk{x)) is assumed to be continuous and strictly increasing 
in each individual objective function fx(x), f2(x), . . . , fk(x). 

We refer to G as a utility function because it combines the mult iple objectives fi , . . . , fk . 



Ho wever, we minimise G for consistency with other authors such as lKlein and Hannanl 1982 1 



and iPrzybylski et al.l 2010a | 



A point x' € X is called k-objective efficient if and only if there is no x € X such 
that fi(x) < fi(x') for each i € {1,2,..., A;} and f%{x) < fi(x') for at least one i. The 
resulting objective vector (/i(x'), f2(x'), . . . , fk(x')) is said to be k-objective nondominated. 
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One typically works in objective space instead of variable space, since each nondominated 
objective vector might correspond to a large number of efficient points in variable space. 

A point x' G X is called optimal if and only if there is no x € X for which G(fi(x), f 2 {x), 
. . . , fk(x)) < G(fi(x'), fiix'), . . . , fk(x')). Because our utility function is strictly increasing, 
any optimal point must also be ^-objective efficient in variable space, and must yield a k- 
objective nondominated vector in objective space. 

Our proposed method of finding an optimal point is based on a shrinking set of bounds 
for the k individual objectives. We update the lower bounds using linear programming relax- 
ations. Where possible, we update the upper bounds by using the lower bounds and inverting 
the utility function ; wher e necessary, we update the upper bounds using the algorithm of 



Ozlen and Azizoglul 2009J. The shrinking bounds allow us to avoid unpromising portions of 
the integer efficient set, and the method of updating these bounds is designed to solve integer 
programs only when absolutely necessary. 

Algorithm [T] gives the stepwise description of our procedure to find an optimal point for 
the nonlinear utility function G(fi(x), f 2 (x), ■ ■ ■ , fk( x ))- Key variables that we use in this 
algorithm include: 

• G BE , the best known value of the utility function; 

• ff B and f^, the current lower and upper bounds on the values of the individual 
objective functions. 

Algorithm [T]terminates with a G BE value that is the minimum of G(f\(x), f 2 (x), . . . , fk(x)) 
among all efficient points; moreover, each time we update G BEST we can record the corres- 
ponding efficient x € X. Stated formally: 

Theorem 1. Algorithm [7] finds the minimum value of G(fi(x),f 2 (x), . . . , among all 

integer efficient points for the MOIP problem, and also identifies a corresponding x £ X that 
attains this minimum. 

Proof. As the algorithm runs we maintain the following invariants: 

• The utility G BEST is obtainable; that is, G BEST = G{fi{x)J 2 (x), . . . , f k (x)) for some 
feasible integer point x € X. 

• Either G BE is already equal to the optimal utility, or else the optimal utility can be 
achieved for some point i£l with f LB < fi(x) < ff B for each objective i G {1, . . . , k}. 

In essence, the lower and upper bounds f^ B and f^ B are used to bound the region of the 
integer efficient set that remains to be examined. It is easy to see that these invariants hold: 

• In Step 0, each f^ B is oo, each ff B is the global minimum for fi(x), and G BEST is 
obtained from a known point x £ X. 

• In Step 1, any point x € X with fi(x) > ff must have a utility worse than G BEST . This 
is because G is strictly increasing, and so any such x must satisfy G(fi(x), . . . , fi(x), . . . , 
fk{x)) > G(f[ B (x), ...,ff,..., fj^ B {x)). The revised upper bound of [f^\ is valid 
because each fi{x) G Z. 
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Algorithm 1 Optimising G over the efficient set of a MOIP problem 
Step 0. Find some initial set of points /. 

Initialise G BEST = mm xeI G{h(x), f 2 (x), . . . , f k (x)). 

Solve Min fi(x) s.t x G X for each i € {1,2, ... , fc}. 

Set each f LB to the corresponding optimal objective value. 

Set each ff B to oo. 

Step 1. If G(f LB , / 2 LB , . . . , ft B ) > G BEST then STOP. 

For each objective i G {1,2, ... ,k}, find ff that solves 

G(/f* . . . , • • • , / fc LB ) - G BEST . 

If this is impossible because G(/f s , . . . , z, fff x , f LB ) < G BEST for all z, 
set ff = oo. 

Set /f s = min( [/^J , /f B ) for each i e {1, 2, . . . , k}. 

Step 2. For each objective i 6 {1,2,..., fc}: 

Solve the LP relaxation of 

Min fox) s.t. x G X, A(x) < /f B , / 2 (a;) < . . . , and f k (x) < ft B . 

Let f LP — fi{x*) be the optimal objective value and x* be the corresponding 

optimal solution, and set f LB = |~/j ip ] • 
Hi* is integer and G{h{x*), f 2 (x* ),..., f k (x*)) < G BEST , 

set G BEST = G{h{x*), f 2 {x*), . . . , f k (x*)). 

If the lower bound f EB is updated for any objective i then go to Step 1. 
Step 3. Use Ozlen and Azizoglul 2009j to update the upper bound f k B ■ Specifically: 



Begin generating all nondominated objective vectors for the (k — l)-objective MOIP problem 
Min/xCz), f 2 (x), ...,f k -i{x) 

s.t. x G X, h(x) < f™, f 2 (x) <f 2 UB ,..., f k (x) < f k UB . 
Each time we generate a (k — l)-objective vector, fix the first k — 1 objectives to the 

values found and minimise fk{x). This two-step "lexicographic optimisation" yields a 

fc-objective nondominated objective vector for the original problem. 
If no feasible point exists then STOP. 

Each time we generate a nondominated fc-objective vector /*, 
test whether G(ff,f 2 , . . . , ft) < G BEST . 

If true, set G BEST = G(/ x *, ft,..., ft) and go to Step 1 immediately. 
Let S be the set of all nondominated objective vectors that were generated above. 
Set f^ B = max/ e s f k — 1 and go to Step 2. 
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In Step 2, the revised lower bounds are valid because each optimal LP value /• is 
equal to or better than the corresponding optimal IP value. Again we can round [// , ' P ] 
because each fi(x) G Z. 

In Step 3, any revision to G BE is valid because it comes from an efficient point: in 
part^EE^i^H 

show that each solution x £ X to the lexicographic 



optimisa tion in Step 3 is a fc-obje ctive efficient point. The revision to fj/ B is valid 
because Ozlen and Azizoglu 2009| show there cannot exist any other efficient point 
having objective function value fk(x) between maxj G 5 fj. and the previous value of fj^ B - 

Note that ff- always exists in Step I because G is continuous, and because our invariants 
give G(f LB , fl B x , f EB , fifi, ft B ) < G BEST - moreover, this f t A is simple to find using 
standard univariate search techniques. 

To prove th at the algorithm terminate s: Even if no bounds are updated in Steps I or 2, 



the procedure of lOzlen and Azizoglu! |2009| will reduce the bound fV B in Step 3. This ensures 



that the bounds shrink during every loop through the algorithm, and because these shrinking 
bounds are integers we must terminate after finitely many steps. 

To prove that the algorithm gives the optimal utility: Upon termination, either G BEST is 
at least as good as anything obtainable within our bounds f EB < fi(x) < (if we STOP in 
Step 1 or 2), or else these bounds have been reduced so far that the remaining integer efficient 
set is empty (if we STOP in Step 3). Either way, we know from our invariants that G BEST is 
obtainable and that no better utility is possible. □ 

Some final notes: 

• In Step 2, hoping for an integer solution x* is optimistic. However, this simple test is 
cheap, and it can speed up the computation in the case where x* 6 Z. 



Ozlen and Azizoglu 2009| implement Step 3 using e multipliers for objectives, thereby 



transforming the lexicographic optimisation from Step 3 into a set of single-objective 
problems; see the paper for details. Other algorithms for generatin g nondominated ob 



ective vectors and/or efficient points may be used here instead of lOzlen and Azizoglu 



2009] (for instance, in cases where highly efficient problem-specific algorithms are known) 



• Although the MOIP problem in Step 3 is the computational bottleneck of the algorithm, 
it has only k — 1 objectives, and we do not require all solutions (since we exit step 3 
as soon as the bound G BEST is updated). Both of these features make it significantly 
easier than the initial /c-objective problem. 

4 An example problem 

In this section we illustrate our approach on a concrete example with k = 3. This is a tri- 
objective assignment problem of size 5x5, with the nonlinear utility function G(fi(x), f2(x), fy(x)) 
fi (x) 3 + f?(x) 3 + .fofx) 3 . The individual objective coefficients for the problem, taken from 



Ozlen and Azizoglu 2009| , are provided in Table [TJ 



The iterations of Algorithm [T] are summarised in Table [2] Columns in this table show 
the solutions of LP and IP problems in objective space, and the updated values of lower and 
upper bounds on the individual objective functions and the utility function as they appear in 



Tab. 1: Objective coefficients for the example problem 



c\ 


1 


2 


3 


4 


5 




C2 


1 


2 


3 


4 


5 




C3 


1 


2 


3 


4 


5 


1 


99 


19 


74 


55 


41 




1 


28 


39 


19 


42 


7 




1 


29 


67 


2 


90 


7 


2 


23 


81 


93 


39 


49 




2 


66 


98 


49 


83 


42 




2 


84 


37 


64 


64 


87 


3 


66 


21 


63 


24 


38 




3 


73 


26 


42 


13 


54 




3 


54 


11 


100 


83 


61 


4 


65 


41 


7 


39 


66 




4 


46 


42 


28 


27 


99 




4 


75 


63 


69 


96 


3 


5 


93 


30 


5 


4 


12 




5 


80 


17 


99 


59 


68 




5 


66 


99 


34 


33 


21 



Algorithm [TJ For the columns representing bounds, an empty cell indicates that the value has 
not changed from the line above. 

For the initialisation in Step the procedure solves three lexicographic IPs, minimising 
objectives in the following lexicographic order: 1-2-3, 2-1-3, 3-1-2. There are of course many 
alternate methods of initialisation; we use lexicographic IPs here because they produce a good 
spread of nondominated objective vectors. 

Step 1 then sets (and later updates) upper bounds on the individual objective functions 
based on the current best solution, G BEST . Step 2 updates the lower bounds by solving the 
linear programming relaxations with the upper bound constraints on the individual objective 
function values. Steps 1 and 2 are iterated for as long as they continue to update these lower 
and upper bounds. When the bounds cannot be updated further, Step 3 generates tri-objective 
nondominated objective vectors by generating a bi-objective nondominated set based on the 
upper bounds f^ B , f^ B and f^ B - If Step 3 is able to improve upon the best utility value 
qBE ST ^ jj. re t urns t Step 1; otherwise it updates f^ B and returns to Step 2. In the final 
iteration, where Step 3 fails to find any feasible points within the current bounds, the entire 
algorithm terminates. 

The optimal solution with G(96, 186,204) = 15 809 256 is identified at an early stage but 
it takes a large number of iterations to prove its optimality. We see from Table [2] that our 
shrinking bounds perform very well for this example: Algorithm [1] requires the solution of 
just eight IPs to find the optimal utility value. If we were to use the naive method from the 
introduction and generate all no ndominated objectiye vect ors then we would require a total of 



56 IPs to solve, as described in lOzlen and Azizoglul (2009] . This illustrates the way in which 



many IPs can be avoided (by eliminating nondominated objective vectors without explicitly 
generating them) using the shrinking bound techniques of Algorithm [T] 

5 Conclusion 

In this study we propose a general algorithm to optimise a nonlinear utility function of multiple 
objectives over the integer efficient set. As an alternative to the naive method of generating and 
evaluating all nondominated objective vectors, we restrict our search to a promising subset 
of nondominated vectors by computing and updating bounds on the individual objectives. 
T he nondominated vectors w ithin this promising subset are generated using the algorithm 



of lOzlen and Azizoglul [2009l | . As illustrated by the example in Section HJ these bounding 
techniques can significantly reduce the total number of IPs to be solved. Because solving 
IPs is the most computationally expensive part of the algorithm, we expect these bounding 
techniques to yield a significant performance benefit for the algorithm as a whole. 

For larger problems that remain too difficult to solve, Algorithm [T] can be used as an 
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Step 


#IP 






/2O) 




qBEST 


ttLB 
Jl 


J2 


13 


G LB 


pUB 
Jl 


f UB 
H 


f UB 
J3 





1 


IP Min f 1 {x) 


86 


214 


324 


44, 448, 624 


86 


— 00 


— 00 


636, 056 


00 


00 


00 





2 


IP Min / 2 (:iO 


209 


128 


367 






128 




2, 733, 208 











3 


IP Min f 3 (x) 


291 


348 


129 








129 


4, 879, 897 








1 




Find ff.ff.ff 


















342 


346 


346 


2 




LP Min fi(x),i = 1, 2, 3 


86 


130.2 


129.1 






131 


130 


5, 081, 147 








1 




Find ff,f£,fg 
























3 


4 


IP Min /iO),/ 2 0s) 


86 


214 


324 


















3 


5 


IP Min /iO),/ 2 (x) 


96 


186 


204 


15, 809, 256 
















1 




Find ff,f£,fg 


















224 


234 


234 


2 




LP Min fi(x),i = 1, 2, 3 


93.5 


169.8 


157.3 




94 


170 


158 


9,687,896 








1 




Find ff,f£,f£ 


















190 


222 


215 


2 




LP Min fi(x),i = 1, 2, 3 


95.1 


178.4 


167.6 




96 


179 


168 


11, 361, 707 








1 




Find ff,f£,f£ 


















174 


216 


209 


2 




LP Min fi(x),i = 1, 2, 3 


95.6 


181.3 


173.7 






182 


174 


12, 181, 328 








1 




Find ff,ff,f£ 


















165 


212 


207 


2 




LP Min fi(x),i = 1, 2, 3 


95.8 


182.4 


177.6 






183 


178 


12, 652, 975 








1 




Find f?,f£,f£ 


















159 


210 


206 


2 




LP Min fi(x),i = 1, 2, 3 


95.8 


183.1 


179.7 






184 


180 


12, 946, 240 








1 




Find ff,f£,f£ 


















155 


208 




2 




LP Min fi(x),i = 1, 2, 3 


95.9 


183.5 


181.6 








182 


13, 142, 808 








1 




Find /j\/ 2 A 


















152 


207 




2 




LP Min fi(x),i = 1, 2, 3 


95.9 


183.7 


182.6 








183 


13, 242, 727 








1 




Find /^,/ 2 A 


















151 


206 




2 




LP Min fi(x),i = 1, 2, 3 


95.9 


183.7 


183.5 








184 


13, 343, 744 








1 




Find /j 4 ,/^ 


















149 


205 




2 




LP Min fi{x),i = 1,2, 3 


95.9 


183.7 


184.4 








185 


13, 445, 865 








1 




Find 


















148 


204 




2 




LP Min fi(x),i = 1,2, 3 


95.9 


183.8 


185.3 








186 


13, 549, 096 








1 




Find /j 4 ,/^ 


















146 






2 




LP Min ft(x),i = 1, 2, 3 




183.9 


185.5 


















3 


6 


IP Min /i(aO,/ 2 (*) 


96 


186 


204 
















203 


3 


7 


IP Min AOO./aCx) 


int. 






















2 




LP Min fi(x),i =1,2 


97.3 


184.6 






98 


185 




13, 707, 673 








1 




Find ff.fg.fg 


















144 


203 




2 




LP Min fi(x),i = 1, 2, 3 


97.3 


184.7 


186.4 








187 


13, 812, 020 








1 




Find 


















143 


202 




2 




LP Min fi(x),i = 1, 2, 3 


97.3 


184.7 


187.3 








188 


13, 917, 489 








1 




Find /j 4 ,/^ 


















141 


201 




2 




LP Min fi(x),i = 1,2, 3 


97.3 


184.8 


188.3 








189 


14, 024, 086 








1 




Find /j 4 ,/^ 


















139 


200 




2 




LP Min fi(x),i = 1,2, 3 


97.3 


184.9 


189.2 








190 


14, 141, 817 








1 




Find /^,/ 2 A 


















137 






2 




LP Min ft(x),i = 2,3 




184.9 


189.4 


















3 


8 


IP Min MaO./aOc) 


inf. 






15, 809, 256 


98 


185 


190 


14, 131, 817 


137 


200 


203 



Tab. 2: Iteration details of Algorithm [T] on the example problem instance 
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approximation algorithm. We can terminate the algorithm at any time, whereupon G BE 
and G(f± B , f£ B , . . . , f^ B ) wm gi ye upper and lower bounds for the optimal utility, and we 
will have a feasible point x G X for which G(f\(x), f2{%), ■ ■ ■ , fk{ x )) = G BEST . 

We hope that this study stimulates future work in the field of multi-objective optimisation. 
One promising direction for future research may be to apply our algorithm to specific families 
of MOCO problems. The special structure of the constraints in these families might help to 
improve the efficiency of our algorithm for nonlinear utility functions. 
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